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Abstract 

H 

h— H Recently, it has been observed that terminated low-density-parity-check (LDPC) convolutional codes 

fj (or spatially-coupled codes) appear to approach capacity universally across the class of binary memoryless 

channels. This is facilitated by the "threshold saturation" effect whereby the belief-propagation (BP) 

^ threshold of the spatially-coupled ensemble is boosted to the maximum a-posteriori (MAP) threshold of 

J^ the underlying constituent ensemble. 

CN In this paper, we consider the universality of spatially-coupled codes over intersymbol-interference 

(ISl) channels under joint iterative decoding. More specifically, we empirically show that threshold 



o 



X 



saturation also occurs for the considered problem. This can be observed by first identifying the EXIT 
curve for erasure noise and the GEXIT curve for general noise that naturally obey the general area 
theorem. From these curves, the corresponding MAP and the BP thresholds are then numerically obtained. 
With the fact that regular LDPC codes can achieve the symmetric information rate (SIR) under MAP 
decoding, spatially-coupled codes with joint iterative decoding can universally approach the SIR of ISI 
channels. For the dicode erasure channel, Kudekar and Kasai recently reported very similar results based 
on EXIT-like curves. 
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I. Introduction 

Irregular low-density parity-check (LDPC) codes can be carefully designed to achieve the capacity of 
the binary erasure channel (BEC) |tU and closely approach the capacity of general binary-input symmetric- 
output memoryless (BMS) channels Q under beUef-propagation (BP) decoding. LDPC convolutional 
codes, which were introduced in ||3l and shown to have excellent BP thresholds in Q, 0, have recently 
been observed to universally approach the capacity of various channels. The fundamental mechanism 
behind this is explained well in ||6l, where it is proven analytically for the BEC that the BP threshold of 
a particular spatially-coupled ensemble converges to the maximum a-posteriori (MAP) threshold of the 
underlying ensemble. A similar result was also observed independently in Q and stated as a conjecture. 
Such a phenomenon is now called "threshold saturation via spatial coupling" and has also been empirically 
observed for general BMS channels |8|. In fact, threshold saturation seems to be quite general and has 
now been observed in a wide range of problems, e.g., see ||9l, ifTOll . lOTI . |[T2l . |[T3l . |[T4|Q 

In the realm of channels with memory and particularly intersymbol interference (ISI) channels, the 
capacity may not be achievable via equiprobable signaling. For linear codes, a popular practice is to 
compare instead with the symmetric information rate (SIR), which is also known as Ci.u.d. ifTSl , because 
this the rate is achievable by random linear codes with maximum-likelihood (ML) decoding. A numerical 
method for tightly estimating the SIR of finite-state channels in general was first proposed in |[T6l . lITTll . 
For LDPC codes over ISI channels, a joint iterative BP decoder that operates on a large graph representing 
both the channel and the code constraints lITSl . lITSll can perform quite well and even approach the SIR 
|[T9l . EOl . Progress has been made on the design of SIR- approaching irregular LDPC codes for some 
specific ISI channels ||T9]| . lIlTI . |[22ll . ||23]| . EO l. However, channel parameters must be known at the 
transmitter for such designs and therefore universahty across ISI channels appears difficult to achieve. 

Since spatially-coupled codes and the threshold saturation effect have now shown benefits in many 
communication problems, it is quite natural to consider them as a potential candidate to universally 
approach the SIR of ISI channels with low decoding complexity. In fact, the combination of spatially- 
coupled codes and ISI channels was recently considered by Kudekar and Kasai lITTll for the simple dicode 

'To be precise, the papers (9), 1111 . 1121 only observe the threshold saturation effect indirectly because the considered EXIT-like 
curves provide no direct information about the MAP threshold of the underlying ensemble. 

October 12, 2011 DRAFT 



erasure channel (DEC) from II241I . EOll . They provided a numerical evidence that the joint BP threshold of 
the spatially coupled codes can approach the SIR over the DEC (by increasing the degrees while keeping 
the rate fixed). Also, they outlined a tentative proof approach for the threshold saturation following the 
ideas in |l6l. However, the EXIT- like curves they considered were not equipped with an area theorem and 
therefore could not be directly connected with the MAP threshold of the underlying ensemble. Thus, the 
threshold saturation effect was indirectly observed. 

In this paper, we begin by considering the transmission of the spatially-coupled codes over the class of 
generalized erasure channels (GECs) of which the DEC and BEC are two particular examples. For these 
channels, we provide a rigorous analysis of the upper bound on the MAP threshold of LDPC codes by 
extending the analysis in ll25l beyond the BEC caseQ For the DEC, we then employ a counting argument 
and present a numerical evidence that this bound is indeed tight for regular ensembles. With the MAP 
threshold determined, the threshold saturation phenomenon can be observed to occur exactly for the 
several channels from the GECs. Next, we also consider the case of more general ISI channels where, by 
deriving the appropriate GEXIT curve and associated area theorem, the MAP threshold upper bound can 
be computed and threshold saturation can be seen. As a consequence, it is possible for spatially-coupled 
codes to closely approach the SIR of ISI channels under joint iterative BP decoding because regular 
LDPC codes can achieve the SIR under MAP decoding ETl . 



II. Background 

In this section, we briefly describe our notation for ISI channels, LDPC ensembles, the joint iterative 
decoder and spatially-coupled codes. 

A. ISI Channels and the SIR 

Let the input alphabet X be finite, {Xi}i^z be the discrete-time input sequence (i.e., Xi e X) and 
{Yi}i<^z be the discrete-time output sequence. Many ISI channels of interest can be modeled by 

Yi^j^atXi.t + Ni, (1) 

where the channel memory is v, {at}^^i is the set of tap coefficients and {Ni}i^z is a sequence of 
independent noise random variables. One can also write the above as Yi - Z-i + Ni where Zi - Y!t=o (^tXi-t 
is the ISI output without noise. In this paper, we restrict ourself to the class of binary-input ISI channels. 

^The upper bound technique on the MAP threshold for the DEC was first mentioned in an earlier paper by one of the authors 
(26) 
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Often, the tap coefficients are represented through a transform domain polynomial a{D) - T,t=o'^tD^- 
For example, when a{D) = 1- D, the channel is known as the dicode channel. 



The main subject of Section III is the class of generalized erasure channels (GECs) in 11241 . EOl . For 
the GEC, one can evaluate its SIR (see f2M . EOl for details) as 

Is{e)^l- f' f{t,e)dt (2) 

Jo 

where f{t,e) is the function which maps t, the a priori erasure rate from the code, and the channel 

erasure rate e to the erasure rate at the output of the channel detector |20|. Strictly speaking, in this 

paper we mainly consider a subclass of the GECs where the channel output sequence can be modeled 

as a deterministic mapping of the input sequence plus erasure noise. 

Example 1: The simpliest example is the dicode erasure channel (DEC), which is basically a Ist-order 

differentiator (i.e., a{D) = I - D) whose output is erased with probability e and transmitted perfectly 

with probability 1 - e. Furthermore, if the input bits are differentially encoded prior to transmission, the 

resulting channel is called the precoded dicode erasure channel (pDEC). The simplicity of the channel 

models allows one to analyze the recursions used by the Bahl-Cocke-Jehnek-Raviv (BCJR) algorithm 

|[28l to compute 

4e2 

/DEc(t,e)=^2-t(l-e))2 (3^ 

for the DEC and 

4ehil-e(l-t)) 

/pDEc(i,6)- (i_^(i_2i))2 (4) 

for the pDEC. For both cases, explicit calculations give Is - I - j^ EOll . Note that this formula also 
applies for the BEC where one has /(t, e) - e and /s(e) - I- e. 



Section IV considers more general ISI channels among which the most important is probably linear ISI 
channels with additive white Gaussian noise (AWGN). For this class of ISI channels, the SIR is given 
bfl 

Unfortunately, no closed-form solutions for the SIR are known in this case. Instead, the numerical method 
described in |[T6ll . llTTl . ||29ll is typically used to give tight estimates of the SIR. 

A vector (Xi,X2, . . . ,X„) is denoted by X" for convenience. 
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Figure 1. Gallager-Tanner-Wiberg graph of the joint BP decoder for ISI channels. The notations a, b,c, d denote the average 
densities of the messages traversing along the graph used in density evolution (DE). The quantities inside the brackets are erasure 
rates used in DE for the GEC case. The update schedule of the joint BP decoder is also implied by the arrows in this figure. 



B. LDPC Ensembles and the Joint BP Decoder 

The standard irregular LDPC ensemble is characterized by its degree distribution (d.d.), which rep- 
resents the fraction of nodes (or edges) of particular degrees. From the edge perspective, the d.d. pair 
consists of two polynomials A(x) = Y.i>i\x^~^ and p{x) = T,i>iPiX^~^ whose coefficients Aj (or pi) 
give the fraction of edges that connect to bit (or check) nodes of degree i. The LDPC ensemble can also 
be viewed from the node perspective where its d.d. pair L{x) - X!i>i Lix'^ and R{x) - Y.i>i Ri^^ have 
coefficients Lj (or Ri) equal to the fraction of bit (or check) nodes of degree i. The design rate of an 

LDPC ensemble is given by 

^_^ L'{1) _^ IoPix)dx 
^'(1) jQ^Xix)dx 

When LDPC codes are transmitted over the ISI channels defined by ([1]), one can construct a large 
graph by joining the code graph and the channel graph together as depicted in Fig. [T] Working on this 
joint graph, a joint iterative decoder typically passes the information back and forth between the channel 
detector and the LDPC decoder. This technique is termed as turbo equalization and was first considered 
by Douillard et al. in the context of turbo codes [30|. For analysis, we also require the addition of 
a random scrambling vector to symmetrize the effective channel 1311. This is very similar to using a 
random coset of the LDPC code to allow analysis of the decoder using the all-zero codeword assumption; 
this technique was also used in [15] where they proved a concentration theorem and derived the density 
evolution (DE) equations for ISI channels. 



October 12, 2011 



DRAFT 







fr\/ 


troUis node 


9 


bit node 





check node 








Figure 2. The joint graph for the {l,r, L) ensemble over the ISI channels. Illustrated in this figure is the case when I = 3 and 



C. Spatially-Coupled Ensembles 

The class of spatially-coupled ensembles in general can be defined quite broadly. In this paper, we 
mainly consider two basic variants (see details in ||6l) as discussed below. 

1) The {l,r,L) ensemble: The {l,r,L) spatially-coupled ensemble (with / odd so that / = ^ e N) can 

be constructed from the underlying (/,r)-regular LDPC ensemble. At each position from [l,L] one has 

M bit nodes and -M check nodes just like in the (/,r)-regular case. However, each bit node at position 

i is connected to check nodes at the same position, at / positions to the left and / positions to the right 

(one check node from each position). In doing this, one also needs to add -M extra check nodes at each 

of / extra positions on each side. For example, a joint code/channel graph for the (3, 6, L) ensemble and 

the ISI channels is shown in Fig. |2] The design rate of the {l,r,L) ensemble is given by 

l\ I l-l 
r L 



:(/,r,L) = (l-^) 



2) The {l,r,L,w) ensemble: The {l,r,L,w) can be obtained with the introduction of a "smoothing" 
parameter w. One still places M variable nodes at each position in [1, L] but places -M check nodes at 
each position in [l,L + w-l]. Each bit node at position i is connected uniformly and independently to a 
total of / check nodes at positions from the range [i,i + w-l]. By adding this randomization of the edge 
connections with the parameter w, for large enough w the system behaves like a continuous one and a 
proof of the threshold saturation effect becomes feasible IQ. The design rate of the {l,r,L,w) ensemble 
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is given by 

\ r I r L 

III. ISI Channels with Erasure Noise: The GECs 

In this section, we focus on the class of GECs. We will present some closed-form analyses on the 
(E)BP EXIT curves of the joint BP decoder. This allows us to obtain an estimate of the MAP threshold 
of the underlying ensemble. Then, DE is used to computed the BP thresholds of the corresponding 
spatially-coupled ensembles and the threshold saturation effect is demonstrated. 

A. BP and EBP Curves for the GEC 

For the class of GECs, the DE update equation of the joint BP decoder is given by 

x(^^i) = /(L(l - p(l - x(^)), e)A(l - p{l - x(^))) 

where x^^^ is the average erasure rate emitted from bit nodes to check nodes during the ^th iteration ll20ll . 
Let X denote the limit of x^^^ when ^ -> oo. The fixed point (FP) equation is then given by 

x = f{Liy{x)),e)Xiy{x)) (5) 

where, for simplicity of notation, we use y{x) = 1- p{l- x) (and sometimes y for short). 

For most of the GECs, /(t, e) is strictly increasing in e for fixed t. In this case, there exists a unique 
function ^{t,v) such that f{t,^{t,v)) - v and one can obtain 

Example 2: For the DEC case, one has /(t, e) = (2-t('i-eW ^'^^ ^^^^ gives the FP equation x - 



4e^A(i/) 



(2-L(2;)( 



^^z^sryi- One can also solve for ^(i, v) - {2 - t) j i^ - t\ and gets 



.(.)= /-^fa'-» . (7) 

Definition 1: Consider a d.d. (A,p) pair and the sequence of LDPC ensembles LDPC(n, A,p). For 
each C picked uniformly at random from LDPC(n, A,p), let X^ be chosen randomly and uniformly at 
random from C and and Y^ be the received sequence after transmission over a GEC with erasure rate e 
and initial state 5o. The associated EXIT function is defined as 



h{e) = lim Ec 



de 
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When BP estimator is used at each bit instead of the optimal MAP estimator, one also has the BP-EXIT 
function which is given by the following definition. 

Definition 2: Consider the same setting as in Definition [T] the associated (joint) BP-EXIT function is 
defined to be 



/.-(e) ^ lim /^-'^(e) 



where 



/i-'*(e) = lim Ec 



lj^ dHiX ^\Y,ie),£f'',So) 



n ~l de 



and Sf^' is the extrinsic BP estimate of the ith bit after iteration i. 

Lemma 1: For simplicity of notation, let us write Y^i to denote the sequence Y"" \ ¥{. Then, the EXIT 
function and BP-EXIT function (after iteration £) can be written as 

1 



/i(e) = lim Ec 



/i-''^(e) = lim Ec 



n 



Y,H{Zi\Y.i{e),So) 



i=l 



1 



n 



E^(^.|fr(K.(6)),5o) 



i=l 



(8) 
(9) 



where Zi is the ith output without noise. From this, one can see that h{e) < /i^^(e). 

Proof: Let ei be the erasure rate of the channel from Zi to Yi. For any extrinsic estimator £, one 
has 

H{X'^\Y{e^),£{Y.^),So) = H{Z^^\Y{e^),£{Y.^),So) 

^H{Z,\Yi{ei),£{Y.i),So) + H{Z.i\Yi{e,),£{Y.,),Zi,So) 

= eiH{Zi\£{Y.i),So) + H{Z.,\Yi{ei),£{Y.i), Zi, Sq). 

Since the second term on the R.H.S. does not depend on ej, it is clear that 



dH{Xf\Yi{ei),£{Y.,),So) 
dei 



^HiZ,\£iY.,),So). 



By letting ei - e for all i and considering two specific cases of £, one obtains ^ and (J9]). 

Furthermore, by data processing inequality |[32l . one has H{Zi\Y^i{e),So) < H{Zi\£- ' (llj(e)),5o) 
which implies h{e) < /i^ '^(e) hence h{e) < /i^^(e). ■ 

While computing the (MAP) EXIT function in general is hard, it is relatively easy to compute the 
BP-EXIT function. 

Lemma 2: The BP-EXIT function for the GEC is given by 

d rL(y) 



h'^'^ie)-^. / f{t,i)dt 

oe Jo 



(10) 
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where L{y) is the extrinsic erasure rate given by the FP equation at channel erasure rate e. 

Proof: Let Y{^{e) be the result of passing Xf through the communication channel, e.g., the GEC, 
with erasure rate e and, with some abuse of notation, £i{p) be the result of passing X" through the 
extrinsic channel which is modeled as BEC with erasure probability p. Similarly to |20|, let T„(l -t, e) = 
~T,i=iI{XuY{^{^)-,£~i{p)) denote the mutual information transfer function where £^i comprises the 
sequence of extrinsic bit estimates except for the ith bit. We also let fn{t,e) = 1 - T„(l - 1, e). By the 
area theorem ll33l . |[25l Th. 2], one obtains 



X 



S -I n 1 



n 



i=l 



n 



(11) 



We then have 



d_ 
de 



- / /„(t,e)dt = -— / T„(l-t,e)dt 
e Jo oe Jo 

_d_ 
" de 

_ d r^ I ^ 



[ f' -f^H{X,\Y^{e),£.,{t))&t 
e JO n ^^i 



(12) 



d_ 
de 



1 " 
Y^H{X^\Y^{e),£^{5)) 



n 



i=l 



(13) 



where ( 12 1 holds because - X!"=i H{Xi) is not a function of e while ( 13 1 follows from i\ lb. 



If one considers the BP estimator, for each fixed £, by letting n ^ oo, fn{t,e) converges pointwise to 
f{t,e) (see ll20l ) while the expectation of the R.H.S. of (13 1 converges to h^^'^{e) if we choose e - e. 



Then, by letting £ ^ oo, one reaches a FP where 6 ->■ L{y) and finally obtains 

-/ /„(t,e)di =/i«P(e). 

oe Jo e=e 



Example 3: For the DEC and pDEC, using the result of Q and Q, one has the following BP-EXIT 
functions 



h 



BP 
DEC 



'^)=iX 



46-2 



(2-t(l-6))2 

2eL{y){A-L{y){2-e)) 
{2-L{y){l-e)Y 



dt 



(14) 



and 
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EBP 
^pDEC 



oe Jo 



d f^iv) AeH{l-~e{l-t)) 

2eL\y){2-e{l-2L{y))) 
{l-e{l-2L{y))Y ' 



dt 



where x is the DE FP at channel erasure rate e and y - y{x). The formula (14i for the DEC case is 
equivalent to the result shown in ll26ll by analyzing the BCJR algorithm. 



d rL(y) ~. 



Also, one can apply (10 1 for the BEC to obtain a known result /ibec(^) ~ 'Bilo ^^^ ~ ^{v) 



(e, /.-(.)) 



Using an approach similar to Il25l Sec. III-B] and taking care of Q and ( [TO] ), one gets the following 
parametric form for the BP-EXIT function. This involves in defining 

as the unique finite union of disjoint intervals that represent all stable and achievable FPs of DE equations. 
Please note that J represents the number of discontinuties in the BP-EXIT function. For the case J > 1, 
let x^^ = x^ and e^^ = e(a;^^) is the joint BP decoding threshold 125, Sec. III-B]. 

Lemma 3: Given a d.d. pair (A,p), the BP-EXIT function for the GEC is given parametrically as 

follows 

(e,0), 6 6[0,e«P) 

where e{x) is given in ([6]). 

In 1251, the extended BP (EBP) EXIT curve for the BEC was introduced as the hidden bridge between 
the BP threshold and its MAP counterpart. In a similar manner, the EBP-EXIT curve for the GEC is 
given below with its own area theorem. 

Definition 3: For a given d.d. pair (A,p), the EBP-EXIT curve for the GEC is defined by the pair 

U^)^Tr. / /(t,6)dt_ ,:e6[0,1] 

\ oe Jo <^=<x)) 

where e{x) is given in ([6]). 

Example 4: For the DEC case, using ([T]) and ( 14 ), the EBP-EXIT curve is given by 

2-L(y(x)) 



2y/^^-Liyix)) 



.L{y{x))\2 



X 



xL{y{x)) 

X{y{x)) 2X{yix)) 



xe [0,1]. 



Lemma 4: Consider the GEC and a d.d. pair (A,p). Define the "trial entropy" as 

P(x)- [''h^''''{t)e'{t)dt 
Jo 
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where /i^^^(x) is the second coordinate the EBP-EXIT curve. Then, we have 

r^(y^ L'(i) 

P(x)= / f{t,eix))dt--^{l-Ril-x)-xR'{l-x)). (15) 

Jo -R (1) 

Proof: First, we let 

Q(x)= / fit,eix))dt--^il-Ril-x)-xR'il-x)) 
Jo -R (1) 

= / fit,e{x))dt-L'{l) / ndy(u) (16) 

JO Jo 



where in (16 1, integration by parts is used. 



Then, one can use Leibniz's rule to get 

'L(y) d 



Q'ix) = f{L{y),e{x))y'L'{y)+ —f{t,e{x))dt-L'{l)xy' 

Jo ox 

= / /(t,e(x))dt (17) 

Jo ox 

rL(y) d d 

= / 7ry^/(t,e(x))-6(x)dt 
Jo Oe(x) ax 



de{x) 

■L{y) Q 
de{x) 
e'(x)/i^'''^(x) 



- e'(^) / T^^/(t,6(x))dt 

Jo oeix) 



P'{x) (18) 



where (17i follows from the DE equation f {L{y) , e{x)) X{y) - x and the fact that \{y) = jtM while 



( 1 8 1 follows by taking deravative. 

Thus, Q{x) and P{x) may differ by a constant. By seeing that P(0) = (5(0) = 0, one must have 
P{x) = Qix). U 

Example 5: For the DEC, explicit calculation gives 

2-L{y){l-e{x)) R'{1) 
Also, one can see that, for the EEC, this gives same formula as in ll25l . 

Theorem 1: (Area Theorem for EBP) Consider a d.d. pair (A, p) of design rate r. Then the EBP EXIT 

curve for the GEC satisfies 

r\^^^(x)de(x) = r. 
Jo 

Proof: Using the result in Lemma |4j a direct calculation reveals that 
and the theorem is proven. ■ 
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B. Upper Bound on the MAP Threshold 

Because of the optimality of the MAP decoder in the sense that h^'^^ < hP'^ (see Lemma [I]), one 
can obtain an upper bound on the MAP threshold by first finding the largest value x^^^ such that 
j^MKvh^^^{x)de{x) = r and then bound the MAP threshold by the inequaUty e^^^^ < e^^^ = e{x^^^). 
This technique was introduced by Measson et al. in ll25l in the context of BEC and conjectured to be 
tight in many scenarios. In fact, for the whole class of regular LDPC ensembles over the BEC, this bound 
was analytically proven to be tight |l34l . 

With the ingredients provided in our analysis above, the technique can also be extended to the whole 
class of GECs. A corollary of Lemma |4] implies in a few steps that one can find x^^^ as the unique 
solution of P{x) = in [x^^,l]. From this, it is also clear that, ^^^^ for the case of regular LDPC 
ensembles quickly approaches e^'*^ of the GEC which is formalized by the following theorem. 

Theorem 2: Consider the (/,r)-regular ensemble. Consider a fixed design rate r = 1 - -. Then 

lim ^''\l,r)^e^^\-r) 

Z,r->oo,r fixed 

where e^''^(r) is the corresponding erasure rate when SIR defined in ^ equals r. 

Proof: First, x'^'^^(/,r) must be the solution of P{x) - 0. For a fixed rate r, x'^'^^(/,r) is bounded 
away from zero for / large enough (one can show that :j^^^(1^ r) for the GEC is not less than x^^^{l, r) 
for the BEC and the latter converges to 1 - r [6, Lm. 8]). Suppose that all the limits are taken when 
l,r ->■ oo while r is kept fixed. Then, we have (1 - x^^^{l,r)y~^ ->• exponentially fast. 
Next, one also sees that 

L(y(x^^P(/,r)))-(l-(l-x^^P(Z,r))"-i)'^landA(y(x^^P(Z,r))) (19) 

which can be obtained from 

log(l-(l-x^''P(/,r))"-i) 

-^ ^77 1! ^ 0- (20) 

l/(r-l) 



To see (20), we apply L'Hopital's rule and use the fact that 

(l-x^^P(/,r))'-i 







(l-(l-xMAP(/,r-))'-i))/(r-l)2 
because the numerator vanishes exponentially while the denominator only vanishes quadratically fast. 



Note that for (/,r) -regular ensemble, (15 1 can be rewritten as 



~L(y) i,^ .._! / 



/(t, e(x))dt + -(1 - xy-^{l + (r - l)x) - - = 0. (21) 

or r 
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Figure 3. EBP EXIT curves for (3, 6) and (4, 8) regular LDPC ensembles over the DEC. Projection of the left most point of 
the curves on to the e-axis allows one to determine e^^. Setting the area under the EBP curves to be equal to the design rate r 
can help find e^"^ . 



Therefore, we can use P(x (l,r)) - and (21 1, (19 1 to have 



JO r 

In addition, from definition we have /q /(t,e^^'^(r))dt = 1 - /^(e^^^l^r)) = 1 - r. Therefore, 

and one has e'^'^^(Z,r) -^ e^^'^(r) as /s(-) is a continuous and monotone function. ■ 

Example 6: Let us consider the DEC. For rate one-half ensembles, we have e'^'^^(3, 6) k. 0.638659, 
^MAP^4 g) ^ 0.640163, €^^^^(5,10) ^ 0.640355, e^^^{7M) ~ 0.640387, £^^^^(8,16) ^ 0.640388 that 
quickly approach e^'^(^) r^ 0.640388. This can be partially seen in Fig. 3 where e'^'^^(4, 8) is already 
very close to e^'^. 

C Tightness of the upper bound 

In this section, we discuss the tightness of the e^^^ bounding technique. Assume that the joint BP 
decoder is run on the joint graph of the LDPC code and GEC. Since one never gets errors in the GEC, 
the joint BP decoder must reach a FP where no more bit nodes can be decoded. At this FP, one obtains a 
residual graph (see ll35l Ch. 3]) by removing all the known bit nodes as well as their neighboring check 
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nodes and the edges connecting them. Then, one can follow the general procedure to show that the MAP 
bounding technique is tight, i.e., by seeing at channel erasure rate e^^^, the design rate of the residual 
graph is zero and providing numerical evidence that for this residual graph, the actual rate converges to 
the design rate as the blocklength n ^ oo. 

We start with the following lemma. 

Lemma 5: Consider a d.d. pair {\,p) and the GEC with channel erasure rate e. First, run the joint 
BP decoder until it reaches a FP so that we obtain a residual graph. Next, use the remaining channel 
constraints to merge all bit nodes that must have the same value. The expected check node d.d. of the 
residual grapqj is given by 

Reiz) ^R{l-x + zx)-R{l-x)- zxR'{l - x) (22) 

where x is the FP of DE and y = I- p{l- x). Furthermore, if the expected bit node d.d. is 

L,{z)^ / f{t,e)dt (23) 

Jo 

then at e = gJ^^P, the design rate of the residual graph f ^map equals zero. 

Proof: Consider the original graph at the FP and let x be the average erasure rate from a bit node 

to a check node. Pick a check node of degree j in the original graph. We can obtain a check node of 

degree i < j in the residual graph by removing all (j -i) edges with known values. Note that i > 2 since 

a check node of degree one must not be in the residual graph. The remaining i edges of this check node 

must contain erasure messages. The probability for this event is (■^)(1 - x)^^'"^^ x\ Thus, the check node 

d.d. for the residual graph (normalized by the number of check nodes in the original graph) iqj 

i 



Re{z)-Y.RjT{%-^)^'~'\^^y 

j>2 i=2^'^' 

= R{l-x + zx)-R{l-x)- zxR'{l - x) 



and (|22l) holds. 



Suppose the bit node d.d. is given by (23l, one has L[(z) - y'L'{yz)f(L{yz),e) and R[{z) 



The check node and bit node d.d. are normahzed with respect to the original graph. 

This formula is the same as the check node d.d. for residual graph left by the peeling decoder for the BEC, obtained via 
solving a differential equation in fTI . 
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xR'{l - X + zx) - xR'{\ - x). Therefore, one obtains 

L[{1) yL'{y)f{L{y),e) 



R'^(l) xR'{l){l-p{l-x)) 
_ L'{1) Xiy)fiL{y),e) 
R'{1) x 

R'{1) 
by using (|5}, y = l-p(l-x) and the known facts that L'{y) = L'{l)X{y) andi?'(l-x) = R'{l)p{l-x). 
Note that the standard d.d. pair from the node perspective of the residual graph is ( -';^' , -';^' ) and 
the corresponding design rate is then 



f. = 1 



R',{1) 4(1) 



Using (24 1, it now is clear that 

R'il) L,(l) Le(l) 

where the last equality follows from (22), ( p3] ) and ( [T5] ). 



By considering a special case e = e'^^P, one has t^map = P{x^^^)/L^map{1) = 0. ■ 

Remark 1: For the BEC, the bit node d.d. given in ( p3] ) matches the known result in ll35l Th. 3.106]. 

In fact, this also holds for the DEC case which can be shown by the following lemma. 

Lemma 6: Consider a d.d. pair (A,p) and the DEC with erasure probability e. The expected bit node 

d.d. in this case follows the form ( |23] ), i.e., 

2-L{yz){l-e) ^^ V 2 / 
Consequently, at e = e^^^ the design rate of the residual graph equals zero. 

Proof: The bit nodes in the residual graph must connect to the trellis section of the form depicted 
in Fig. |4] for some /c e N (otherwise, the joint BP decoder can still decode). 
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y y ,y 




Figure 4. A trellis section in the residual graph for the DEC. The notation "?" denotes that an erasure is received at the channel 
output. One can form a larger bit node by merging all the bit nodes that attach to this trellis section. 



The probability of the trelUs configuration (?,0,...,0,?), where ? indicates an erasure, is e^ (''^) ■ 
Given the above treUis configuration, if all messages from check nodes to the bit nodes that attach to this 
trellis section are "?" then all these bit nodes remain in the residual graph. On the other hand, if at least 
one of the messages is not "?", then the joint BP decoder can decode and then remove all these bit nodes 
from the residual graph. Therefore, one can consider all the bit nodes that attach to such a trellis section 
as one larger bit node whose degree is the sum of the k + 1 component degrees. The generating function 
for this sum of fc + 1 i.i.d. random variables is L{z)^^^. This is quite similar to the graph reduction 
technique discussed in |[36l for IRA/ARA codes. 

From the above analysis and since each edge is associated with erasure rate y, the d.d. (normalized by 
the number of bit nodes in the original graph) of residual graph after graph reduction is then given by 

fc=o V 2 / 2-L{yz){l-e) 



From the above analysis, once one has t^map = 0, the final missing piece to prove the tightness of the 
MAP upper bound is to show that the actual rate of the residual graph is equal to its design rate with 
high probability (when the blocklength tends to oo|j While a general proof for this still requires some 
analytic work, one can use the test in ll35l Lm. 3.22] to numerically verify if this is true. To do this, one 
just needs to show that the function '^{u) introduced in Il35l Lm. 3.22], for the residual graph, has the 
following property: ^(u) < in the interval [0, 1] with equality only at n = and u - \. For our case. 



•^If this is true, then the MAP decoder can decode perfectly at e^'^^ and e^'^^ = e^'^^ . 
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Figure 5. Function ^(m) for the residual graph obtained after joint BP decoding of the (3,6)-regular LDPC ensemble over 
the DEC. This shows numerically that the MAP upper bound is tight in this case. 



the bit node d.d. for the residual graph from ( 23 1 might have unbounded degrees as in ( 25 1 for the DEC 
case. However, for this DEC case, since the fraction of bit nodes, for the (/,r)-regular ensemble, that 
have degree l{k + l) is upper bounded by (|)'^ and therefore L^{z) has an exponentially vanishing tail, 
one can truncate the series L^{z) at some large enough k and obtain the result with a negligible error. 
For example, one can truncate L^{z) at A; = 20 and for the (3,6)-regular ensemble, the truncated version 
of ^(u) is numerically shown to satisfy the desired property in Fig. B] 

D. Spatially-Coupled Codes for the GEC 

Consider the {l,r,L,w) spatially-coupled ensemble over the GEC. The joint code/channel graph is 
similar to the one in Fig. |2] which is for the (/, r, L) ensemble. We also follow the DE equation discussed 
in lOn to compute the BP thresholds of the coupled ensembles. The main difference is that we use the 
correct EBP curves with their operational meaning instead of the EXIT-like ones used in [11]. Let x^ 
denote the expected erasure rate at iteration i from bit nodes at position i to check nodes. For i ^ [l,L], 



(I) 
set x) - 0. Let us define 






) ^i+w-l) 
5 ^i+w-l) 



1 w-1 / 1 w-1 

^ j=0 \ ^ k=0 
1 -iil-l / 1 w-l 



Xi+j-k 



Xi+j-k 



r-l 



r-l\ 



l-l 
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Figure 6. EBP EXIT curves for (3, 6, L, 5) over the DEC with L = 2L + 1 where L = 2, 4, 8, 16, 32, 64, 128, 246. For small 
values of L, the increase in threshold can be explained by the large rate-loss. As L grows larger, the rate loss becomes negligible 
and the curves keep moving left, but they saturate at the MAP threshold of the underlying regular ensemble. 



The DE equation for the joint BP decoder can be written as 



,(^+1) 



/(r(x 



in 



M) 



M) 



M) 



j-w+l' • • • '^i+wj-l-'' ^) ' •S'V^i-to+1' • • ■ J^i+w-U 



for i e [1, L]. To compute both the stable and unstable FPs of DE, one can use the fixed entropy DE pro- 
cedure outlined in [37, Sec. VIII] where the normalized entropy of a constellation gr-^' - {x\ , . . . ,Xj^ ), 
which is defined as xiHL^^^) - x'^i=i i ' ^^ ^^P*- constant at every iteration by varying the channel 
parameter. With each FP x obtained, one can compute the EBP EXIT value of the spatially-coupled 
ensemble as -^ T,i=i h^^^{xi). 

The threshold saturation effect of coupling can be nicely seen by plotting the EBP EXIT curves for the 
uncoupled and coupled codes. For the DEC, Fig. [6] shows the EBP curves for the (3,6,L,5) ensembles 
with various L along with the EBP curve of the underlying (3, 6)-regular ensemble. From the EBP curves, 
one can determine e^^(3, 6) f« 0.56892 and £"^^^(3, 6) ^ 0.63866. The BP thresholds of spatially-coupled 
ensembles for small L due to rate-loss can have larger values, e.g., £^''(3, 6, 17, 6) ?« 0.64170 > e'^^''(3, 6). 
However, for a wide range of L, i.e., L - 33, 65, 129, 257, 513, we observe that e^^(3, 6, L, 5) ?« 0.63866 
which is essentially e^'^''(3,6) while the rate loss gradually becomes insignificant. In ifTTl , Kudekar 
and Kasai provided a similar plot but here we include the MAP threshold estimate e^^^ and use the 
EXIT function hF^^ instead of the EXIT-like L{y) in ifTTll . Similarly, one can also verify the threshold 
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Figure 7. EBP EXIT curves for (3, 6, L, 5) over the pDEC with L = 2L+1 where L = 2,A, 8, 16, 32, 64, 128, 246. Threshold 
saturation can also be observed for this case. 



saturation over the pDEC channel as seen in Fig. It] For the pDEC, the BP threshold for (3,6)-regular 
ensemble is e^^(3,6) k. 0.52877 and by using spatial coupling, the BP threshold can be boosted to 
e'^^(3,6,L,5) ^ e^^^(3,6) ^ 0.63877 with negligible rate loss for L large. 

Even though the threshold saturation effect has been only shown numerically for the DEC and pDEC, 
the method is readily applicable to the whole class of GECs. Still, the analytic proof for threshold 
saturation remains open for the GEC. Such a proof combining with Theorem |2] would essentially 
demonstrate the SIR-achieving capability of spatially-coupled ensembles. 

IV. General ISI Channels 

In this section, we shift our focus to ISI channels with more general noise models. The MAP upper 
bound for general BMS channels was presented by Measson et al. and conjectured to be tight |37|. For 
general ISI channels, we apply a similar technique to give an estimate of the MAP threshold of the 
underlying uncoupled ensemble by first constructing the BP-GEXIT curve that follows an area theorem. 
While our method can be used for a wide range of noise models, we particularly focus on the case of 
AWGN. The BP thresholds of the corresponding coupled ensembles are then computed via DE and the 
threshold saturation effect is also observed. In addition, simulations on the performance of the joint BP 
decoder for coupled codes of finite length are conducted to validate these thresholds. 
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A. GEXIT Curves for the ISI channels 

Consider an ISI channel of memory u. When the channel input X" is chosen uniformly at random 
from a suitable binary linear codq^ the ISI output without noise Zi at some index i is a discrete random 
variable characterized by its probability mass function pz,{^) ^^^ ^11 values z in the alphabet Z. For 
example, in the case of a dicode channel, Z = {0,+2,-2} and pz.i^) - \^PZi{+'^) - PzX~'^) - \- The 
channel from Zi to Yi is a |^|-ary input memory less channel characterized by its transition probability 
density Py.|z. (y^)- Without specifying the index, we denote h = H{Z\Y) and get 

h^H{Z)-I{Z;Y) 

Instead of looking at a particular channel, we assume that the channel from Zi to Yi is from a smooth 
family {Af(hj)}h; of |2^|-ary input memoryless channels characterized by conditional entropy hj. A 
further assumption is made that all individual channel families are parameterized in a smooth way by a 
common parameteirl e, i.e., h, = H{Zi\Yi){e). 

With the convention that y^i - y" \ yi, define (f)i{y^i) - {Pzi\Y^i{z\y~i) '■ z e Z} and the random vector 
$j = (/)j(lli). Each value of (pi is a vector of length \Z\ in the {\Z\ - 1) -dimensional probability simplex. 
The index of the vector associated with z e Z is denoted by [z]. One can see that $i is a sufficient 
statistic for estimating Zi, i.e., Zi -s- ^i{Y^i) ->• Y^i forms a Markov chaiirl 

Definition 4: Suppose the initial state in the trellis is Sq. Let Xf chosen according to px^{xi) be the 
input sequence, Z" be the ISI output sequence without noise and Y"" be the final channel output sequence, 
i.e., Yi is the result of transmitting Zi over the smooth family {M(hj)}h, of memoryless channels. Then 
the ith GEXIT function is 

Gi(hi,...,h„) = (26) 

ohi 

and the average GEXIT function is defined by 

1 " 
G(hi, . . . ,h„) = - ^Gi(hi,. . . ,li„). 



n 



i=l 



The code is proper |,35„ p. 14] and its dual code contains no codewords involving only O's and a run of (u + 1) I's. 



For AWGN case, a convenient choice for e is e = -77^7. 
One way to see this is to write 

PzAZt) PzA^i) 

where er^i is the standard basis column vector with a 1 in the index [z], and apply the result from |35 p. 29]. 
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For the case where all channel families are the same, i.e., hj = h, we have 

1 dH{Xf\Yr{h),So) 

G(h) = — . 

n dh 

Remark 2: The above form of the GEXIT function naturally conforms with the generalized area 
theorem. Thus, we are able to write the GEXIT curve and use the MAP bounding technique. 

Lemma 7: Assume that all the channel famihes are the samep^ i.e., hj = h. The ith GEXIT function 
is given by 



Gj(h) = Y,p{z) / ^i,z{v)Ki^z{v)di 



where aj^^ is the distribution of the vector <I>j given Zj = z, v is a vector of length \Z\ in the {\Z\ - 1)- 
dimensional probability simplex and the GEXIT kernel (for i and z) i ^ 



f^i,z{v) = 



r°° d I I M f £z'^r^'iP(2/ik') I . 

/-oo h>hii\z) log2 I ,^Jjpi^^|,) [ d2/i 



Proof: Suppose the initial state is ^o, we start by writing 

= H{Z.^Y'^, 5o) + H{Z.i\Y^,Z,, So). (27) 

For simplicity of notation, we drop 5o in all the expressions although the dependency on 5*0 is always 



implied. From (26 1 and (27 1, it is clear that 



G,(h) . A^(^^|yn). (28) 

dh,; 



We also have 

H{Zi\Y^^) ^ H{Zi\Y„^,{Y.i)) 

p{zi\(j)i)p{yi\zi) 



f f T^PizMHzMvM) log J P^'ff^)P^yf dy^d^^ (29) 

J'p'Jy' z, 11, z'p{Zim)p{yi\Zi)\ 



where (29l follows from the B ayes' theorem and the fact that 

p{zi,(j)i,yi) ^p{zi,(t)i)p{yi\(t)i,Zi) ^ p{zi)p{(J3\zi)p{yi\zi) . (30) 

'"Note that for the case of different channel families, one can still compute the ith GEXIT function as a function of the 
common parameter e. 

p{yi\z) is dependent on hi and hence is dependent on t. 
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Note that (30l is true since Yi and $i(lli) are independent given Zi, i.e., Yi ->■ Zi -^ <i>j(K,j). 



Taking derivative and using p(zj|(/)j) = p{zi\y^i), we gef^ 



where 



Jy^ dhj \ V[^^p{yi\z) J 

f d {i:z'V[z']P{yi\z')\ ^YL^ 



Finally, by seeing that 

d\i, ^ dH{Zi\Yi{e)) 
de de 



V- r r ^^ I I .. \Y.z'P{^)p{yi\z)\, 
z -iy^ de [ p{z)p{yi\z) J 



we obtain the result. ■ 

Remark 3: For erasure noise and the GEC in particular, h = H{Z\Y) = eH{Z) (scaling e by H{Z)) 
and since in this case 

HiZ) [ Viz] 

G(h) = jfTY) (scaling h{e) by WzT-' where /i(e) is the EXIT function for the GEC. 

Remark 4: At cr = for AWGN case (or at e = for erasure noise), h = and aj ^ is "delta at v- Cf^j" 
where e^z] is the standard basis vector. At this extreme, G(0) = since kj ^(w) = 0. At the other extreme 
cr ^ 00 (or at e = 1 for erasure noise), h = H{Z) (e.g., 1.5 for the dicode channel) and G(h) = 1 since 
in this case aj^ is "delta at v^z'] -p{z') Vz'". 

1) BP-GEXIT curve (with AWGN): In this section, we are particularly interested in computing the 

RP f 

BP-GEXIT function for ISI channels with AWGN. In this case, let <I>^ ' denote the extrinsic estimate 

RP / 

of Zi at the ^th round of joint BP decoding. If ^- ' is used instead of $i in the above formulas then 
one has the BP-GEXIT (at the Ah round) G^^^'^ in a similar manner to (33 and the overall BP-GEXIT 
G^^(h) = lim^^oo G^'''^(h). Also, notice that the two extremes in Remark UJ still apply when the BP 
decoder is used instead of the MAP decoder. 

"One can verify that the terms obtained by taking derivative with respect to the channel inside the logj vanish. 
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Next, AWGN implies that p{yi\z) = -y^e'^^i^ and then §-^p{yi\z) = ((y, - zf - a'^)p{yi\z). 
Therefore, the corresponding ith BP-GEXIT is G^^' (h) = ^ where 

^ = L,P{z) j^ a . ; (v) ^_^ p{yi\z) I — -^ 1 y log2 i 2^ -^e ^ \ dyidv 



-EK.)£*,|.){^-i|.oJEfl.'^-S^|d.. 



and 

In the limit oi £ ->■ cxs, one can run the DE for ISI channels |[T5]| to obtain the DE-FP and compute the 
quantities A and B at this FP With some abuse of notation, let a^^\ b^^\ c^^^ and d^^^ denote the average 
density of the bit-to-check, check-to-bit, bit-to-trellis and trellis-to-bit messages, respectively (see Fig. 
[TJ, at iteration i with initial values (at £ - 0) being Aq, the delta function at 0. Also, let n denote the 
density of channel noise. The DE update equation for joint BP decoding of a general binary-input ISI 
channels is 

a(^)=d(^-i)®A(b(^-i)), 



c 



(i) 



L{b^% 



d(^)=r(cW,n) 

where for a density x, A(x) = Y,i AjX®(*"^\ p(x) = Y,i Pix"*"*'"^) and L(x) = Y,i LiX®\ The operators ® and 
H are the standard density transformations used in ll35l p. 181]. The map r(-, •) is not easy to compute in 
closed form for general trellises and often one needs to resort to the Monte Carlo methods (i.e., running 
the windowed BCJR algorithm with window parameter VF on a long enough trellis - see details in |15|) 
to give the estimates. A similar method was used to upper bound the MAP threshold for turbo codes 
over BMS channels |[38l . 

The denominator B can be computed either by numerical integration or by Monte Carlo methods. 
Meanwhile, the numerator A involves in the quantity v^^] - p{Zi - ^I'^i) where T^ denotes the com- 
putation tree of depth £, rooted at index i, which includes all channel and code constraints associated 
with £ iterations of decoding. This computation tree if excludes the tree root yi and is implied by the 
decoding schedule in the DE equation. The quantity v^^], due to complications from the trellis, is not 
easy to obtain in closed form. However, one can readily compute v^^] as an extra output of the BCJR 
algorithm (already used in DE) as 

viz]"^ E aj-i(si_i)-7j(si_i,Sj)-/3j(sj). 

Si,Si-i:Zi=z 
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where 7j(sj_i, Sj) is probability of the input Xi that corresponds to the transition from state Sj_i (at time 
index i - 1) to state Si at (time index i) given the computation tree T^. Here, ai(-) and /3j(-) are the 
standard forward and backward state probabiUties in the BCJR algorithm. Note that the scaling constant 
can be chosen so that Y,^ v^^] - 1- 

B. Upper Bound for the MAP Threshold 

As briefly discussed before, the above-mentioned GEXIT curve naturally follows the area theorem 

nH{Z) nH{Z) 

/ G(h)dh= / G(h)dh = r. 

JhMAP Jo 

One can also apply |[37l Lm. 4] to the BMS channel from Z" to Y^ and obtains 

dhi ~ dhi 



Consequently, by invoking (28 1, one has the optimality of the MAP decoder in the sense that G(h) < 
G^^(h). Therefore, one can use the discussed bounding technique, i.e., by finding the largest value h^^^ 
such that the area under the BP-GEXIT curve equals the code rate. 



L 



G''P(h)dh = r, 

JjMAP 



to obtain the MAP upper bound h^^^^ > h^^^ (as J^^iP G''P(h)dh = J^^L^^ G(h)dh < J^L^^ G''P(h)dh). 

For example, the BP-GEXIT curve for the (3, 6)-regular LDPC code over an AWGN dicode channel 

with a{D) - {l-D)/\/2 following the analysis in Section IV-A is shown in Fig.^ In this case, h^^(3, 6) Ri 



0.851 ± 0.001 (the corresponding^ 0-^^(3, 6) ;« 1.703 ± 0.001 dB) while h^^^^CS, 6) ^ 0.920 ± 0.001 (or 
^^^^^(3,6) Ri 0.959 ±0.001 dB). Similarly, for the (5, 10) -regular LDPC code, one has h''P(5,10) «< 
0.716 ± 0.001 and h'^'^P(5, 10) !« 0.931 ± 0.001. The corresponding thresholds measured in dB can be 
found in Table. U 

C. Spatially-Coupled Codes on the ISI Channels 

Consider the {l,r,L) spatially-coupled ensemble. For the ISI channels, the DE equation for this 
ensemble can be obtained from the protograph chain in a similar manner to the case of memoryless 
channels discussed in If39il . For each i,j e [1 - l,L + I], let a- J- (and b^J-) denote the average density 



l_>j V J^J/ 



We adopt the convention that a is the SNR threshold measured in dB. 
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regular 


DEC 


Dicode AWGN 


^BP 


-MAP 


^SIR 


a^' 


-MAP 

a 


^SIR 


(3,6) 


0.5689 


0.6387 


0.6404 


1.073 


0.959 


0.823 


(5,10) 


0.4647 


0.6404 


0.6404 


3.032 


0.834 


0.823 



Table I 
Threshold estimates of (l, r)-REGULAR ensembles over the DEC and dicode AWGN channel. For AWGN 

NOISE, THE THRESHOLDS ARE MEASURED IN DB. 




1.5 



Figure 8. The BP-GEXIT curve for (3, 6)-regular and (5, 10) -regular LDPC codes over an AWGN dicode channel with 
a{D) = (1 - D)/\/2. The upper bound h is obtained by setting the area under the BP-GEXIT curve (the shaded region) 
equal to the code rate. 
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of the messages from bit nodes at position i to check nodes at position j (and the other way around]^ 
With all the initial message densities (at i - 0) being Aq, the DE update equation (for alH e [1,L]) is 



[j'€[l-Ll+l]\j J 

j'e[i-Li+i] 

where ®je{ji,...jt} Xj and [lie{jj,...,ij} Xj denote the operations Xj^ ® Xj^ ® . . . ® Xj^ and x^^ H Xj^ H . . . H Xj^, 
respectively. 

D. Simulation Results 

In this section, we start with the {l,r,L) circular ensemble obtained by considering all the positions 
i > L of the protograph chain to be the same as position i-L (similar to [8 1). The order of bit transmissions 
is "left to right" in each length-L row and then start with the next row (in a total of M rows, see Fig. |2]l. 
The / = raayi{v,l-l) first bits in each row are known. This known bits will "break" the circular ensemble 
into the {l,r,L-I) ensemble and also serve as the pilot bits to fix the trellis state. As a consequence of 
this fixing, one only needs to run the BCJR independently in each row and this can be done in a parallel 
manner ll22l. ll23]l. 

In our experiments, we conduct simulations over the AWGN dicode channel with a{D) = (1 - D)/-\/2 



and memory v = 1. First, we use the DE in Sec. IV-C to compute the BP thresholds of the spatially- 



coupled coding scheme. The results in Fig. ^reveals that o"^^(3,6, 22) is roughly 0.959 ± 0.001 dB 
and approximately the same as 0-^^(3,6,44) whose rate loss is smaller. Notice that this is also roughly 
-MAP^g g^ - the MAP threshold estimate of the underlying (3, 6) -regular ensemble, obtained by the 
bounding technique, and is a significant improvement over cr^^(3,6) Ri 1.703 ±0.001 dB. This suggests 
that threshold saturation occurs for regular ensembles. Since MAP decoding of regular ensembles can 
achieve the SIR lITTll . it also implies that one can universally approach the SIR of general ISI channels 
using coupled codes with joint iterative decoding. To support this, one can also see that for the (5, 10, 44) 

For i i [1,L], set aJJ = A+oo, the delta function at +oo. 
October 12, 2011 DRAFT 



27 



iU 


- 1 i..." 


--<-, 


v1 


' 


, 


' 






-^(3.6.22). 


M = 5000 (target.) = 








•s 




-<-(3.().22). 


M = 5000 (overall) - 


_^ _ O 








\ 
\ 


-o (3.6.22). 


M = 502 (ta.r<;(>t) 


10-2 


= - - - ci^ 

: <^ 


^'^ 


^o^ 


<3 


-^(5.10.44) 


. M = 5000 (ta.r<;(>t) 1 




\ 




^ 


CD 


> 


\ \ 




< 


- 


03 




\ \ 




Y>' 


- 


^10- 




\ 


\' 


\ 1 


' 


O 




\ 


\ 


^^. 


- 


^1 




\ 


\ 




' ^ 


~ 


w 




\ 


> \ 




' V 




-1^ 


^ 


> 


\ \ 




• 




m 10-4 


- T-H. 


cn" 


\ 


\ 




] 




- iS 


CM 


\ 


X, 


< 


- 




Cd ^ — ^ 




\ 


□ 


' \ 




10-^ 


- a d, 

, ^.t^-L^. 


cd 

CO 


\ 


1 




CO 

3 






> 


^ 


1 1 1 1 


\ \ 1 \ \ 1 



0.8 



1.2 1.4 

Eb/No (dB) 



1.6 



1.8 



Figure 9. BER and BP thresholds for the (3,6)-regular LDPC code, (3,6,22) and (5,10,44) spatially-coupled codes over 
the AWGN dicode channel. 



ensemble of the same rate as the (3,6,22) one, the threshold o-'^P(5, 10,44) f« 0.834 ±0.001 dB (which 
is also roughly a^^^{5, 10)) gets very close to the signal-to-noise ratio (SNR) corresponding to the SIR 
{a^^^ ^ 0.823 ± 0.001 dB using the numerical method in lUSl, ifTTl ). 

Also shown in Fig. [9] is the bit error rate (BER) versus SNR plot for the ensembles derived from the 
{l,r,L) circular ensembles of finite M - 502 and M - 5000. For each simulation, we use louter = 20 
channel updates and between two such channel updates, we run linner = 5 BP iterations on the code part 
alone. The curves labeled "target" is the BER for the bits at position I + 1 (right after the known bits) 
in the coupled chain while the curve labeled "overall" is the overall BER for all the positions [/ + 1,L] 
together. One might expect that the "overall" BER will get closer to the "target" BER for large enough 
M and large enough number of iterations. From Fig. |9j one can also observe that the "overall" BER for 
(3, 6, 22) and M - 5000 keeps getting "closer" to the "target" BER as SNR slightly increases. Those 
BER curves are way to the left of e^^(3, 6) - the BP threshold for the underlying (3, 6)-regular ensemble. 
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V. Concluding Remarks 

In this paper, we consider binary communication over the ISI channels and numerically show that 
the threshold saturation effect occurs on both the DEC and dicode channel with AWGN. To do this, 
we construct the EXIT and GEXIT curves that satisfy the area theorem and obtain an upper bound on 
the threshold of the MAP decoder. This upper bound is conjectured to be tight and, for the DEC, we 
show a numerical evidence which strongly supports this conjecture. The observed threshold saturation 
effect is valuable because by changing the underlying regular LDPC ensemble, i.e., increasing the degrees 
according to a fixed code rate, combined with the results of 1 27 1 . it is shown that the joint BP decoding 
of spatially-coupled codes can universally approach the SIR of the ISI channels. 

Also, it has been known that the spatially-coupled codes (or LDPC convolutional codes) inherit some 
other advantages such as the typical minimum distance and the size of the smallest non-empty trapping 
sets both growing linearly with the protograph expansion M |40]. In addition, the convolutional structure 
of the codes allows one to consider a windowed decoder like the one discussed in BTI . ll42ll . All of these 
properties suggest that spatially-coupled codes may be competitive in practice for systems with ISI. 
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